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EXACT INTERVAL SOLUTIONS TO THE DISCRETE 

BELLMAN EQUATION 
AND POLYNOMIAL COMPLEXITY OF PROBLEMS 
IN INTERVAL IDEMPOTENT LINEAR ALGEBRA 

In this paper, we construct a solution to a linear matrix interval 
equation of the form X = AX + B (the discrete stationary Bellman 
equation) over partially ordered semirings, including the semiring 
R + of nonnegative real numbers and all idempotent semirings. We 
also discuss the computational complexity of problems in interval 
idempotent linear algebra (for more detail on idempotent mathe- 
matics, see, e.g., [jl], |2fl). In traditional interval analysis, problems of 
this kind are generally XP-hard |3|, |]]. In this paper, we consider 
matrix equations over positive semirings (in the sense of j5j]); in this 
case the computational complexity of the problem is polynomial. 

Idempotent and other positive semirings naturally arise in opti- 
mization problems. Many of these problems turn out to be linear 
over appropriate idempotent semirings [Ij, [2j]. In this case, the sys- 
tem of equations X = AX + B is a natural analogue of a usual lin- 
ear system in traditional linear algebra over fields. Carre H showed 
that many of the well-known algorithms of discrete optimization 
are analogous to standard algorithms in traditional computational 
linear algebra. 

1. Consider a semiring, i.e., a set S endowed with two associative 
operations, addition © and multiplication 0, such that addition is 
commutative, multiplication is distributive over addition from either 
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side, and 1 are the respective neutral elements of addition and 
multiplication, x = x = for all x G S, and 0^1. Let the 
semiring S be partially ordered by a relation ^ such that is the 
least element and the inequality x =4 y implies that x © z 4 y © z, 
x z =4 y z, and z x =4 z y for all x, y, z G 5; in this case the 
semiring S is called positive (see, e.g., ||). 

A semitring S is called idempotent if for all x G S 

© 

D3j 05 01 • Addition © defines a canonical partial order ^ on 5 by 

the rule x=4yiffx(By = y. Any idempotent semiring is positive 
with respect to this order. Note also that x © y = sup{x, y} with 
respect to the canonical order. In what follows, we assume that 
all idempotent semirings are ordered by the canonical partial order 
relation. 

The best known and most important examples of positive semir- 
ings are "numerical" semirings consisting of (a subset of) real num- 
bers and ordered by the conventional linear order ^ on R: the 
semiring R + with the usual operations © = +, = • and neutral 
elements = 0, 1 = 1; the semiring R max = RU {— oo} with the 
operations © = max, = + and neutral elements = — oo, 1 = 0; 
the semiring R max = Rmax U {oo}, where x^oo,a;©oo = oofor 
all x, x oo = oo x = oo if x ^ 0, and oo = oo 0; and 
the semiring S 1 ^ min = [a, 6], where — oo ^ a < b ^ +oo, with the 
operations © = max, = min and neutral elements = a, 1 = 6. 
The semirings R max , Rmax, and S^min = K b ] are idempotent. 

Many mathematical constructions, concepts, and results over the 
fields of real and complex numbers have nontrivial analogues over 
idempotent semirings. Idempotent semirings have recently become 
the subject of a new branch of mathematics, idempotent analysis 
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Let a positive semiring S be endowed with a partial unary closure 
operation * such that x ^ y implies x* =^ y* and x* = 1©(i*0x) = 
1©(i0 x*) on its domain of definition. In particular, 0* = 1 by 
definition. These axioms imply that x* = 1 © x © x 2 © ■ ■ • © (x* x") 
if 71 ^ 1. Thus x* can be considered as a 'regularized sum' of the 
series x* = l©x©x 2 ©. . . ; in an idempotent semiring, by definition, 
x* = sup{l, x, x 2 , ... } if this supremum exists. 

In numerical semirings, the operation * is defined as follows: x* = 
(1 — x)~ if x -< 1 in R + , x* = 1 if x =^ 1 in R max and R max , x* = oo 
if x >- 1 in R max , x* = 1 for all x in S'^^. In all other cases, 

iiiciA} max, mm ' 

x* is undefined. Note that the operation * is defined everywhere in 
idempotent semirings that are a-complete in the sense of |7j (e.g., 
in R max or S^ min ). For more detail, see g. 

2. Let S be a set partially ordered by a relation A closed 
interval in S is a subset of the form x=[x,x]={iG ( S , |x^i^ 
x}, where the elements x ^ x are called lower and upper bounds 
on the interval x. The order =^ induces a partial ordering on the set 
of all closed intervals in S: x =^ y iff x =<; y and x =<; y . 

A weak interval extension I(S) of a positive semiring S is the set 
of all closed intervals in S endowed with the operations © and 
defined by x © y = [x © y , x © y] , x y = [x0y,x0y] and with 
a partial order induced by the order in S. The closure operation 
in I(S) is defined by x* = [x*,x*] (see also |5j]; for interval analysis 
over R, see, e.g., [§]). 

Proposition 1 The weak interval extension I (S) of a positive semir- 
ing S is closed under the operations © and and forms a positive 
semiring with a zero element [0,0] and a unit element [1,1]. The 
interval x © y (x y) contains the set { x © y | x G x, y G y} 
({x0?/|xGx, i/ G y}, respectively) and its bounds are elements 
of this set. 
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3. Denote by Mat TOn (<S) a set of all matrices A = (a^-) with 
rn rows and n columns, whose coefficients belong to a semiring S. 
The sum A© 5 of matrices A, B G Mat mn (<S) and the product AB of 
matrices A G Matj m (S) and B G Mat mn (S) are defined according to 
the usual rules of linear algebra. If the semiring S is positive, then 
the set Mat mn (*5 f ) is ordered by the relation A = (a^) =<; B = (bij) 
iff ay =4 bij in S for all 1 ^ i ^ m, 1 ^ j ^ n. 

Matrix multiplication is consistent with the order =<! in the fol- 
lowing sense: if A, A' G Mati m (S), B,B f G Mat mn (5') and A 4 A', 
B 4 B', then AB 4 A'B' in Mat/„(S). The set Mat nn (£) of square 
matrices of order n over a (positive, idempotent) semiring S forms 
a (positive, idempotent) semiring with a zero element O = (oy), 
where o^- = 0, 1 ^ i,j ^ n, and with a unit element E = (%), 
where = 1 if i = j and = in the opposite case. 

The closure operation in matrix semirings over a positive semir- 
ing S can be defined inductively (for another way of doing this, 
see 0): A* = (a u )* = (a* n ) in Matn(S) and for any integer n > 1 
and any matrix 



where An G Mates'), A 12 G Mat fcn _ fc (5), A 2 i G Mat n _ fc 
A22 G Mat n _fc n _fc(S), 1 ^ A; ^ n, by definition, 



where D = A22 © A2iA n Ai2. It can be proved that this definition 
of A* implies that A* = A* A © and, thus, A* is a "regularized 

sum" of the series E © A © A 2 © 

Note that this recurrence relation coincides with the formulas 
of the escalator method for matrix invertion in traditional linear 
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algebra over the field of real or complex numbers up to the alge- 
braic operations used. Hence this algorithm of matrix closure is 
polynomial in n. 

Let S be a positive semiring and A = (a^) G Mat mn (I(S)) be 
a matrix whose coefficients are closed intervals in S. The matrices 
L(A) = (a^), U (A) = (a^) G Mat mn (S') are called the lower and the 
upper matrices of the interval matrix A. Evidently, L(A) =^ U(A) 
in Mat mn (S). 

Since, for any positive semiring S, the sets I(S) and Mat nn (S') 
form positive semirings, the sets 7(Mat nn (S')) and Mat nn (I(S)) form 
positive semirings with respect to the operations defined above. 

Proposition 2 The semirings 7(Mat nn (S')) and M&t nn (I(S)) are 
isomorphic to each other, and the isomorphism is defined by A G 
Mat nn (/(5)) » [L(A),[/(A)] G /(Mat nn (5)). 

By definition, the addition and multiplication of matrix intervals 
in I (Ma.t nn (S)) are reduced to separate matrix addition and multi- 
plication of their lower and upper matrices. An analogous statement 
for lower and upper matrices in Mat rm (/(S')) follows from the last 
proposition. 

4. Let S be a positive semiring. The discrete stationary Bellman 
equation has the form 

X = AX®B, (*) 

where A G Mai nn (S), X, B G Mat ns (S'), and the matrix X is un- 
known. Let A* be the closure of the matrix A. It follows from the 
identity A* = A* A E that the matrix A*B satisfies this equation; 
moreover, it can be proved that, in idempotent semirings, this solu- 
tion is the least in the set of solutions to equation (*) with respect 
to the partial order in Mat ns (S'). 
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Let A = A G Mat nn (I(S)), B = B G Mat ns (I(S)). The unified 
(least) solution set of equation (*) is the set E(A, B) = { A*B \ A G 
A, B G B }. The interval X = A*B G Mat ns (I(S)) that satisfies 
equation (*) in the algebraic sense is called the (least) algebraic 
solution to this equation. Other defintions of a solution set of a 
matrix interval linear equation can be found, for example, in [||. 

Our main result is the following theorem. 

Theorem The closed interval [L(A*B), U(A*B)} in Mat ns (5) that 
corresponds to an algebraic solution to equation (*) contains the 
unified solution set E(A, B) of equation (*), and the bounds of this 
interval belong to S(A, B). The algebraic solution A*B can be con- 
structed in a polynominal number of operations. 

The proof follows from the fact that matrix multiplication and 
closure are consistent with the partial order in a matrix semiring. 
The lower and the upper matrices of an algebraic solution A*B 
to equation (*) satisfy the point equations X = AX © B and 
X = AX © B, and algebraic solutions to these equations can be 
constructed by the matrix closure algorithm described in section 3, 
which is polynomial in n. 

Note that this theorem was proved in the paper (see also 
TDfl , Theorem 12.2) in the case of interval linear algebra over the 



semiring R + of nonnegative real numbers. 

Under some natural additional conditions on the operations ©, 
0, and * a stronger equality [L(A*B), U(A*B)} = S(A,B) holds 
in the case of an idempotent semiring S. Moreover, as far as we 
know, there are no iVP-hard computational problems in interval 
linear algebra in this case. This is consistent with the general ob- 
servation that idempotent analogues of constructions in traditional 
mathematics over numerical fields are considerably simpler than 
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their prototypes |[], @, |7j ■ 
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